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We demonstrate the applicability of a new PAINT method to speed up 
iterations of interactive methods in multiobjective optimization. As our test 
case, we solve a computationally expensive non-linear, five-objective problem 
of designing and operating a wastewater treatment plant. The PAINT method 
interpolates between a given set of Pareto optimal outcomes and constructs 
a computationally inexpensive mixed integer linear surrogate problem for the 
q original problem. We develop an IND-NIMBUS® PAINT module to combine 

the interactive NIMBUS method and the PAINT method and to find a preferred 
— solution to the original problem. With the PAINT method, the solution process 

with the NIMBUS method take a comparatively short time even though the 
original problem is computationally expensive. 

m 

o\ 1 Introduction 

O 

In this section, we give background for our study and a brief overview of this 
paper. First, in Section [l~H we describe the aim of this study and the structure 
of this paper. In Section [L2} we introduce the basic concepts of multiobjective 
^ optimization that are used in this paper. In Section [l.3[ we consider the main 

issues related to computationally expensive multiobjective optimization. Fi- 



nally, in Section 1.4, we describe our test case, i.e., the multiobjective problem 



of designing and operating a wastewater treatment plant. 



1.1 About this Paper 

In this paper, we demonstrate how the interpolation method PAINT (intro- 
duced in [T2HT5] ) can be used to speed up the iterations of an interactive 
method when solving computationally expensive multiobjective optimization 
problems. For this, we revisit a computationally expensive five-objective opti- 
mization problem from [37] that models designing and operating a wastewater 
treatment plant. 
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In our study of the wastewater problem, we used the interactive NIMBUS 
method, as was used in [37J. Compared to the previous study of [37], the 
iterations of the interactive method NIMBUS were much faster because of a 
surrogate problem constructed with the PAINT method. In our study, the 
decision maker was Mr. Kristian Sahlstedt as in [37] and, thus, we were able to 
ask the decision maker to compare his experiences of using the NIMBUS method 
to solve the problem with and without the PAINT method. This comparison 
of the two approaches gave a unique perspective to our study. 

The structure of this paper is as follows: After describing the background of 
our study in this section, we outline the PAINT approach to solving computa- 
tionally expensive problems and the PAINT method in Section [2j We describe 
the new IND-NIMBUS® PAINT module (also called the PAINT module in 
this paper for short) in Section [3j In Section |4j we illustrate how we used the 
PAINT method to construct a Pareto front approximation and a mixed integer 
linear surrogate problem for the wastewater treatment problem. In Section |4j 
we also describe our decision maker's involvement in solving the problem with 
the PAINT module. In Section [5j we further analyze the decision making pro- 
cess of Section [4j Finally, in Section [6j we give our conclusions and ideas for 
further research. 

1.2 Multiobjective Optimization 

Multiobjective optimization concerns simultaneously optimizing multiple con- 
flicting objectives. A general formulation for a multiobjective optimization 
problem with k objectives is 

min (/i(x),...,/ fc (x)) , . 

s.t. x G S, { ' 

where are the objective functions and S is the feasible set. A vector x G S 
is called a (feasible) solution. For these problems, instead of a single optimal 
solution there typically exist many Pareto optimal solutions. A solution x G S 
is said to (Pareto) dominate another solution y G S if fi(x) < fi(y) for all 
i = 1, . . . , k and fj(x) < fj(y) for at least one j G {1, . . . , k}. A solution x* G S 
is Pareto optimal, if there does not exist a solution x G S that dominates it. A 
vector z = (fi(x), . . . , with x G S is called an outcome, and an outcome 

is called Pareto optimal if it is given by a Pareto optimal solution. The set of 
Pareto optimal outcomes is called the Pareto front. 

Although many Pareto optimal solutions typically exist, only one has to be 
chosen for implementation. Distinguishing between Pareto optimal solutions 
requires preference information about the objectives of the problem. In multi- 
objective optimization, it is often assumed that there exists a decision maker 
who is an expert in the application area and who is prepared to answer ques- 
tions concerning those preferences. In this paper, this whole process of choosing 
a single solution for implementation is called solving the problem and, when 
we want to emphasize the decision maker's involvement, it is also referred to 
as the decision making process. 

The type of information that is asked from the decision maker depends on 
the multiobjective optimization method that is used to solve the problem. Dif- 
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ferent types of multiobjective optimization methods (as categorized in j22|. I38| ) 
are no-preference methods, a priori methods, a posteriori methods and inter- 
active methods. In no-preference methods the decision maker is not asked any 
questions. No-preference methods are applicable to problems, where the de- 
cision maker is not available or does not want to get involved. In a priori 
methods, the decision maker is first asked for preference information and then 
the best solution according to those preferences is found. The difficulty with a 
priori methods is that the decision maker may find it hard to define preferences 
without ever seeing feasible or Pareto optimal solutions. In a posteriori meth- 
ods, a representative set of the Pareto optimal solutions is found from which 
the decision maker is allowed to choose a preferred one. The difficulty with 
a posteriori methods is that generating a representative solution set may be 
time-consuming and choosing a preferred solution from a large set of solutions 
may be hard (see e.g., [19]). 

In this paper, we follow the ideology of interactive methods in solving mul- 
tiobjective optimization problems. In interactive methods, it is understood 
that any preference information given by the decision maker is only partial 
and perhaps flawed. Thus, the decision maker is allowed to explore the Pareto 
optimal solutions by guiding the interactive method. This allows the decision 
maker to learn about the problem (as argued e.g., in [27]) and find a preferred 
solution without examining too many solutions. For more information about 
interactive methods, see e.g., [H1E7]. More specifically, in this paper, we use 
the interactive synchronous NIMBUS method, introduced in [24-26J. 

1.3 Solving Computationally Expensive Multiobjec- 
tive Optimization Problems 

Some multiobjective optimization problems are computationally expensive (see 
e.g., [21 [ini E3 ETJ H3])- This may be caused e.g., by the need to use compu- 
tationally expensive simulations for evaluating the objective functions. Inter- 
active methods have an advantage to a posteriori methods in solving computa- 
tionally expensive problems, because the decision maker may guide the search 
in interactive methods and, thus, fewer solutions need to be computed. There 
is, however, a drawback. When using interactive methods, the decision maker 
has to wait while new solutions are computed with respect to his/her updated 
preferences. For computationally expensive problems, this may take a long 
time, which may be frustrating for the decision maker (as argued e.g., in [18J). 

In order to compute new solutions faster within the interactive method, 
one can use approximation. Two different approximation schemes can be iden- 
tified: approximating the objective functions and approximating the Pareto 
front. The objective functions may be approximated e.g., with meta-models 
like the response surface methodologies, Support Vector Machines or Radial 
Basis Functions (see e.g., [30]). These have been used in multiobjective opti- 
mization e.g., in [30, 42J. This is not, however, a straightforward task, because 
as the number of decision variables and objectives increases, the approxima- 
tion itself becomes a very computationally expensive task. Another approach 
is approximating the Pareto front. Pareto front approximations can be found 
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e.g., in [U 01 El EH 123 133 03, where ID 13 ED 123 include decision making 
aspects connected to these. Note that in this paper, we distinguish between a 
Pareto front representation (a discrete set of Pareto optimal outcomes) and a 
Pareto front approximation (something more approximate that possibly con- 
tains vectors that are not outcomes of the problem, but merely approximate 
them). 

In this paper, we use the Pareto front approximation approach introduced in 
|12H14| . In those papers, a new Pareto front approximation method PAINT is 
introduced and details on decision making with the produced approximation are 
covered. The PAINT method uses a novel way to integrate the knowledge about 
Pareto dominance into the approximation. The PAINT method interpolates 
between a given set of Pareto optimal outcomes to construct a Pareto front 
approximation. The approach differs from the other approaches for decision 
making with Pareto front approximations (mentioned above) because it is able 
to approximate also nonconvex Pareto fronts. Furthermore, the Pareto front 
approximation constructed with PAINT implies a multiobjective mixed integer 
linear surrogate problem (for the original problem) that can be solved with any 
interactive method. The other approaches are either applicable only to convex 
multiobjective optimization problems or use only a custom-made procedure for 
choosing a preferred point on the approximation. Further details on the PAINT 
method are covered in Section [2] 

1.4 Designing and Operating a Wastewater 
Treatment Plant 

Designing and operating a wastewater treatment plant is a complex problem 
with many conflicting criteria that have to be considered at the same time. In 
this paper, we consider a plant using so-called activated sludge process, which 
is globally the most common method of wastewater treatment. We model the 
problem as a five-objective optimization problem, which was previously studied 
also in [37] • The five-objective problem is an extension of the three-objective 
problem treated in |10j . The approach of this paper differs from the approach 
of [37] because we use the PAINT method to approximate the Pareto front and 
to construct a surrogate problem for the original problem. In this way, the time 
that the decision maker has to wait while using an interactive method becomes 
shorter. 

Figure [T] shows the schematic layout of the wastewater treatment plant that 
was designed in [37]. The wastewater treatment begins with grit removal. Af- 
ter the grit removal, solids are separated by a gravitational settling. Raw and 
mixed sludge removed from the primary settlers is fermented in a separate reac- 
tor and partly recycled back to the water line to provide readily biodegradable 
carbon source for denitrification. The bioreactor consists of four anoxic zones, 
three aerobic zones and one deoxygenation zone. Nitrate-rich activated sludge 
is recycled from zone 8 of the bioreactor to zone 1. Return sludge and primary 
effluent are directed to zone 1. Methanol is injected to zone 2 to support denitri- 
fication. Excess sludge is pumped from zone 8 of the bioreactor to the beginning 
of the water process, from which it is removed in the primary settlers together 
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with raw sludge. Raw and mixed sludge is thickened gravitationally into ap- 
proximately 4.5% total solids prior to anaerobic digestion. Anaerobic digestion 
produces biogas and the produced biogas can be converted into electrical or 
thermal energy. The digested sludge is dewatered by centrifuges into approx- 
imately 28% total solids. The reject water from sludge treatment is pumped 
to the beginning of the plant. The wastewater treatment process is simulated 
with the commercial GPS-X simulator (see [8]) and the model is based on the 
findings of Poyry Engineering Ltd. For more information about the wastewater 
treatment plants using activated sludge process, see e.g., [TO l l32l [37] . 

The objectives of the optimization problem are the amount of nitrogen in 
the effluent (g/m s , grams per a cubic meter of effluent), aeration power con- 
sumption in the activated sludge process (kW), chemical consumption (g/m 3 , 
grams per a cubic meter of effluent), excess sludge production (kg/d, kilograms 
per day) and biogas production (m 5 /d, cubic meters per day). The first one 
is the main goal of activated sludge process and the four others are connected 
to the operational costs. This multiobjective optimization problem allows the 
simultaneous consideration of the performance of the plant (through the nitro- 
gen removal rate) and different aspects of the operational costs. Naturally, the 
last objective is maximized and the others are minimized. Decision variables of 
the problem are the percentage of inflow pumped to fermentation, the amount 
of excess sludge removed, the dissolved oxygen setpoint in the last aerobic zone 
and the methanol dose. Thus, the methanol dose is both a decision variable 
and an objective. 
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Figure 1: A schematic layout of the wastewater treatment plant 

Each simulation of the wastewater treatment plant of [37] took about 11 
seconds on the GPS-X simulator. This made the problem computationally 
expensive. In addition, one could notice from the Pareto optimal outcomes 
computed for the problem that the problem is nonconvex. During the analysis 
in |37j . 200 simulations were run to optimize the scalarizations (i.e., single 
objective optimization problems, whose optimal solutions are Pareto optimal 
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solutions to the multiobjective optimization problem) given by the interactive 
NIMBUS method that was used to solve the problem. This means that each 
iteration of the interactive method took more than half an hour. Even though 
interesting solutions to the problem were found in [37] , the computational time 
of iterations was an inconvenience to the decision maker (according to personal 
communications with the authors of |37] ) . This means that there was room for 
improvement using the PAINT method. 

2 The PAINT Approach to Solving Com- 
putationally Expensive Problems 

In this section, we describe the PAINT approach to solving computationally 
expensive problems. The applicability of the PAINT approach is then demon- 
strated in Section [4] by solving a computationally expensive multiobjective op- 
timization problem of wastewater treatment plant design and operation. 

The PAINT approach is based on the Pareto front approximation con- 
structed by the PAINT method. The PAINT method was proposed in |13| . 
and it is based on the concept of an inherently nondominated Pareto front 
approximation introduced in [T3] and the mathematical concepts of [12| . The 
PAINT method interpolates between a given set of Pareto optimal outcomes 
in a way that the interpolants neither dominate nor are dominated by the set 
of given Pareto optimal outcomes and, in addition, they are not dominated by 
each other (i.e., the interpolation is an inherently nondominated Pareto front 
approximation, as defined in |14|). In this paper, a vector on the Pareto front 
approximation is called an approximate (Pareto optimal) outcome. 

The general functionality of the PAINT method is as follows: The PAINT 
method first constructs the Delaunay triangulation of the given set of Pareto 
optimal outcomes and then chooses the appropriate polytopes from it to the 
Pareto front approximation. In this paper, this is realized with the Octave- 
based (see EI] ) implementation that was developed during the research of 

m 

The Pareto front approximation constructed with the PAINT method im- 
plies a computationally inexpensive mixed integer linear surrogate problem for 
the original problem, as described in [13]. The Pareto front of the surrogate 
problem is exactly the Pareto front approximation and, thus, a preferred so- 
lution to the surrogate problem implies a preferred vector on the Pareto front 
approximation, which is also called a preferred approximate outcome in this 
paper. The algorithm of the PAINT method and more exact details can be 
found in [T3] . 

Decision making in the PAINT approach is described in Figure [2j In the 
PAINT approach to solving computationally expensive problems, we assume 
that there exists a set of Pareto optimal solutions to the computationally ex- 
pensive problem. This set may have been generated with any a posteriori 
method. The set of the related outcomes is inputted into the PAINT method. 
PAINT then interpolates between the set of given Pareto optimal outcomes and 
outputs the interpolation that implies a mixed integer linear surrogate problem 
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Figure 2: A flowchart of the decision making process 

for the original problem. 

After the mixed integer linear surrogate problem has been formulated, the 
decision maker gets involved and uses an interactive method of his/her choice 
to find a preferred solution to the surrogate problem. The outcomes given by 
Pareto optimal solutions to the surrogate problem are vectors on the Pareto 
front approximation, which is in the same space as the original Pareto front. 
Thus, the decision maker is able to give his/her preferences on them. The 
preferred approximate outcome is projected on the actual Pareto front of the 
original problem by solving achievement scalarizing problem (see (401 |4"T] ) with 
the approximate outcome as a reference point. More details on the projection 
can be found in |13j . Projecting the solution may take time, depending on the 
computational costs of the problem. If the problem is very computationally 
expensive, the projection can be done without the involvement of the decision 
maker. 

The projection of the preferred approximate outcome (i.e., a Pareto optimal 
solution to the original problem) is shown to the decision maker and, if he/she 
is satisfied, the decision making process stops, because a preferred solution has 
been found. If the decision maker is not satisfied, it is possible to update the 
Pareto front approximation by adding the new Pareto optimal outcome to the 
given set of Pareto optimal outcomes and by recomputing the approximation 
with the PAINT method. This yields a more accurate approximation and we 
can again use an interactive method to find a preferred solution to the new 
(more accurate) surrogate problem. This process can be repeated as many 
times as necessary. 

The PAINT method is a powerful tool as it can interpolate between any 
given set of Pareto optimal outcomes, i.e., the way that the outcomes have 
been generated does not affect the functionality of the method. In addition, 
since it is based on the concept of inherent nondominance (see |14] ) , it will not 
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provide interpolants that would mislead the decision maker. Finally, the mixed 
integer linear surrogate problem implied by the approximation allows one to 
use any interactive method for finding a preferred approximate outcome on the 
Pareto front approximation. 

The PAINT method has a couple of shortcomings, already noted in |13j . 
First, the PAINT method does not provide any information about the preim- 
age of the Pareto front approximation in the decision space. This means that 
the decision maker has to project the approximate outcome (i.e., the solution 
to the surrogate problem) on the Pareto front of the original problem in order 
to find out the values of the decision variables. Second, the PAINT method 
cannot detect any disconnectedness in the Pareto front, but always interpolates 
between the outcomes whenever the interpolation is inherently nondominated. 
Thus, the approximation might be inaccurate if e.g., the decision space is dis- 
connected or the objective functions are highly nonconvex. 

3 A New IND-NIMBUS® PAINT Module 

IND-NIMBUS® (see [23J ) is a multi-platform desktop software framework, cur- 
rently available for Windows and Linux operating systems, intended to provide 
a flexible tool-set for implementation of multiobjective optimization methods. 
So far, the IND-NIMBUS framework has been used to implement the syn- 
chronous NIMBUS [23H26] and the Pareto Navigator [6] methods. The IND- 
NIMBUS® software can be connected to an external sources that model the 
problem, such as the GPS-X simulator used for modeling the wastewater treat- 
ment plant. For this paper, the IND-NIMBUS® software framework has been 
used to develop a so-called IND-NIMBUS® PAINT module that combines the 
PAINT and NIMBUS methods for computationally expensive multiobjective 
optimization. The PAINT module implements most of the functionalities de- 
scribed in Figure [2} 

The synchronous NIMBUS method |24H26j is an interactive multiobjective 
optimization method. The NIMBUS method uses classification of objectives 
as the preference information. Given a Pareto optimal solution to the multi- 
objective optimization problem, the decision maker can classify the objectives 
into classes I < , I-, I = : , I- and 7 <> defined, respectively, as classes of objective 
functions that the decision maker wants to improve as much as possible, wants 
to improve to a given aspiration level z%, allows to remain unchanged, allows 
to deteriorate until a given bound e, and allows to change freely for a while. 
This preference information is converted into several different single objective 
subproblems with the help of different scalarization functions as proposed in 
|26j . These subproblems are solved to generate different Pareto optimal solu- 
tions, which are shown to the decision maker who can then see how well the 
desired preferences could be attained. The decision maker can choose any of 
these solutions as the starting point of the next iteration, i.e., classification. 
This iterative procedure can either start with a solution given by the decision 
maker or from a so-called neutral compromise solution and it is repeated until 
the decision maker is satisfied with the solution at hand. Further information 
about the synchronous NIMBUS with other means to direct the search process 
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is given in [26]. 

The NIMBUS method has been successfully applied to shape design of ul- 
trasonic transducers [16], designing a paper machine headbox optimal 
control in continuous casting of steel [28], separation of glucose and fructose 
[9], intensity modulated radiotherapy treatment planning |34j . brachytherapy 
|35j and optimizing heat exchanger network synthesis |20j . among others. In 
addition, it uses classification of objectives that has been found cognitively just 
|19j . These facts make the NIMBUS method an ideal choice as the interactive 
method for solving the PAINT surrogate problem of the wastewater treatment 
plant model. 
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Figure 3: A screen shot of the IND-NIMBUS® PAINT module 

Figure [| shows the screen shot of the IND-NIMBUS® PAINT module. In 
the PAINT module, the decision maker can give his/her preferences concerning 
the surrogate problem by classification of the objective functions. The given 
classification information is used to formulate a single objective subproblem 
of the surrogate problem. The subproblem is modeled using the Optimizing 
Programming Language (OPL, see [39]), and this (mixed integer linear model) 
is solved using CPLEX (see [IT] ) . An optimal solution to the subproblem gives 
a new approximate Pareto optimal outcome, corresponding to the preferences 
given by the decision maker. This approximate outcome is shown to the decision 
maker. If the decision maker so wishes, he reclassify the objectives of the new 
approximate outcome which yields another approximate outcome. 

As described in Section [2j approximate Pareto optimal outcomes can be 
projected on the Pareto front of the original problem using the PAINT mod- 
ule (using the Project Solution button near the bottom of the screen). The 
projection of the approximate outcome, that is, a Pareto optimal solution to 



9 



the original problem is shown to the decision make. As mentioned, for a com- 
putationally expensive problem this may take time, but fortunately projecting 
an approximate outcome can be done without the involvement of the decision 
maker. 

The approximate Pareto optimal outcomes and the actual Pareto optimal 
solutions that have been found during the decision making process are visualized 
on the right side of the PAINT module. The decision maker can choose any 
of the approximate Pareto optimal outcomes as the starting point of the next 
NIMBUS iteration (i.e., as the basis for a new classification of objectives). The 
process stops when the decision maker has found a preferred solution to the 
original problem through projecting an approximate Pareto optimal outcome. 

In the current version of the PAINT module, only one of the scalarizations 
of the synchronous NIMBUS method (i.e., the achievement scalarizing sub- 
problem) has been implemented. That is, unlike in the synchronous NIMBUS 
method, the decision maker can see only one approximate Pareto optimal out- 
come for given preferences. It should also be noted that any solver capable of 
solving the surrogate subproblem (e.g., GLPK, see [7]) could be used instead 
of CPLEX. 

The current version of the PAINT module does not implement the construc- 
tion or updating of the surrogate problem. If one wishes to update the surrogate 
problem using Pareto optimal outcomes obtained by e.g., projection, the de- 
cision making process must be stopped, and the surrogate problem must be 
manually updated using Octave. In future versions, updating the Pareto front 
approximation should be implemented under a third button in the PAINT mod- 
ule that would then automatically update the approximation and the surrogate 
problem. 



4 Solving the Wastewater Treatment Case 



In this section, we demonstrate how the PAINT method and the IND-NIMBUS® 
PAINT module were used to solve the wastewater treatment problem, described 



in Section 1.4 First, in Section 4.1, we describe the construction of the Pareto 



front approximation with PAINT before the involvement of the decision maker. 
Then, in Section 14.21 we describe how the decision maker used the PAINT 



module to solve the wastewater treatment problem. 



4.1 Pre-Decision Making phase 

First, a set of 200 mutually nondominated solutions to the wastewater problem 
was found with the evolutionary UPS-EMO algorithm (introduced in [3]) and 
the GPS-X simulator. To study the optimality of these solutions, each one was 
locally improved using an achievement scalarizing problem \40\ |4"T] , which was 
optimized with Matlab fmincon-function with finite differences approximated 
gradients. This resulted in 195 mutually nondominated solutions. The maxi- 
mal improvement in the values of the achievement scalarizing problem was at 
most 3% so the local improvement did not cause much change. This built our 
confidence that the final solutions were close to Pareto optimal. We took the 
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outcomes given by these solutions as the set of given Pareto optimal outcomes 
for the PAINT method. The whole process of producing this set took about 
three days on a standard laptop. 

After this, we computed a Pareto front approximation based on the given 
set of Pareto optimal outcomes with the PAINT method (see Section [2]). The 
PAINT method chose 4272 polytopes for interpolation in the Pareto front. In 
order to reduce the computational complexity of the implied mixed integer 
linear surrogate problem, we removed polytopes that were subsets of larger 
polytopes from the approximation. This resulted in a collection of 608 polytopes 
whose union covered the same space in M 5 as that of the larger collection. In 
addition, all sets of vertices of the polytopes in the collection were affinely 
independent and, thus, the number of vertices of all the polytopes was five or 
less, as shown in |12j . Using the PAINT method to construct the Pareto front 
approximation took approximately 19 hours on Intel® Xeon® E5410 CPU. 

The mixed integer linear surrogate problem implied by the smaller collection 
was equivalent to that implied by the larger collection, but it was computation- 
ally less expensive. As described in [13], the surrogate problem could be written 
as 

min (zi,...,z 5 ) 

B-t- ES EL A;,* = 1 

Ez=i Aj,z < Vj, for all j = 1, ... , 608 

E?=\ Vj = 1 (2) 
where A G [0, l] 608x5 
y g {0, l} 608 

z i = Ej=i ELi l ' 3 for alH = 1, . . . , 5, 

where each row of the matrix A G flj 608x5 contained the indices of the vertices 
of one polytope in the smaller collection of polytopes. The component A,y of 
the matrix variable A G j^608x5 wag f or a n j = 1, . . . , 608 and I = 1, . . . , 5 the 
coefficient of the vertex I of the polytope given by row j in the matrix A. The 
variable y determined which of the rows of the matrix A was nonzero. By the 
third constraint, only one row in the matrix A had nonzero elements. 

Problem Q had 608 x 5 = 3040 continuous variables and 608 binary vari- 
ables. CPLEX was able to solve e.g., an achievement scalarizing problem for the 
surrogate problem in less than a second. This was a tremendous improvement 
to solving a scalarization of the original problem, which took about half an hour 
with the Controlled Random Search algorithm (see [3H]), which is implemented 
in the IND-NIMBUS software. 



4.2 Decision Making Phase 

Using the PAINT module, our decision maker (Mr. Kristian Sahlstedt from 
Poyry Environment Ltd) was able to examine the approximate outcomes and 
to project any of them on the Pareto front of the original problem. This entire 
decision making process was done within a couple of hours and the decision 
maker's involvement was only about an hour, which could not have been pos- 
sible by merely using the original computationally expensive problem. 
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Table 1: The approximate and actual Pareto optimal outcomes inspected by the 
decision maker with the PAINT module 



Before the decision maker started using the PAINT module, we gave him a 
brief overview of the methods from the user's perspective. We told him that 
a set of Pareto optimal outcomes has been computed and that a new PAINT 
method has been used to interpolate between those outcomes. We also informed 
him that the outcomes given by PAINT are only approximate Pareto optimal 
outcomes and, thus, more computation has to be done to find the closest real 
Pareto optimal outcome. In addition, we told him that the PAINT method 
does not unfortunately provide any information about the decision variables 
and those values can only be known after the real Pareto optimal solution is 
found. Since our decision maker had previous experiences with the NIMBUS 
method, all of this was very clear to him. In addition, he did not find any of 
this too inconvenient. 

Table [l] shows the approximate Pareto optimal outcomes generated (approx- 
imate outcomes s 1 , . . . , s 4 ) and the outcomes given by actual Pareto optimal 
solutions to the wastewater treatment problem (outcomes p 1 , p 2 ) that were in- 
spected by the decision maker. The decision making process started from the 
approximate outcome s 1 in Table [1} The outcome s 1 was given by the neutral 
compromise solution to the surrogate problem. 

The decision maker wanted to see further (approximate) Pareto optimal 
outcomes. After a classification of objectives in the PAINT module, the op- 
timal solution to the new subproblem for the surrogate problem gave the ap- 
proximate Pareto optimal outcome s 2 . The approximate outcome s 2 has more 
biogas production than the approximate outcome s , but is worse in all the 
other objectives. Especially, the chemical consumption is very large. Let us 
emphasize that finding the approximate outcome s 2 was especially smooth, 
since the mixed integer linear problem was computationally inexpensive. 

Because the decision maker was not completely satisfied with the approx- 
imate outcome s 2 , he decided to continue and find another approximate out- 
come. This yielded the approximate outcome s 3 , which has much lower chemical 
consumption and a slightly lower excess sludge production than both approxi- 
mate outcomes s 1 and s 2 . Unfortunately, the approximate outcome s 3 is worse 
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than both approximate outcomes s 1 and s 2 in all the other objectives. 

A classification of objectives of the approximate outcome s 3 and solving the 
new subproblem for the surrogate problem led to the approximate outcome s 4 . 
This new approximate outcome is roughly the same as the approximate out- 
come s 3 in both excess sludge production and biogas production. However, the 
amount of nitrogen for the approximate outcome s 4 is slightly higher than for 
the approximate outcome s 3 , but this is compensated by chemical consumption 
and aeration power that are considerably smaller. 

After having inspected the four approximate Pareto optimal outcomes, the 
decision maker felt that he had learned enough about the surrogate problem. 
First, the decision maker decided to project the approximate outcome s 1 on 
the Pareto front of the original wastewater treatment problem. The projection 
of the approximate outcome s 1 (i.e., solution to the achievement scalarizing 
problem with the approximate outcome s 1 as the reference point) took a little 
over half an hour. The projection was done using the GPS-X simulator and 
the Controlled Random Search algorithm. The projection was outcome p 1 in 
Table [l] According to our decision maker's assessment, the outcome p 1 was 
fairly close to the approximate outcome s 1 in all objectives. However, he felt 
that there might still be more preferred solutions to the problem. 

Because the approximate outcome s 1 and the actual Pareto optimal outcome 
p 1 were close to each other, it was decided not to update the Pareto front 
approximation. Instead, the decision maker wanted to project the approximate 
outcome s 4 and obtained the outcome p 2 in Table [lj The Pareto optimal 
outcome p 2 has slightly higher amount of nitrogen in the effluent than the 
Pareto optimal outcome p , but it has considerably lower aeration power and 
the amount of chemical consumption. The Pareto optimal outcome p 2 was 
very preferred by the decision maker and he chose it as the final solution to the 
problem. 

The final solution (including a way to design and operate a wastewater 
treatment plant) will be further inspected by more accurate simulators before 
implementing. However, it will act as a guideline for the design of the wastew- 
ater treatment plant. 

5 Analyzing the Decision Making Process 
with PAINT 

We filmed our decision maker Mr. Sahlstedt during the decision making process 
and asked him some additional questions regarding the usability of the methods. 
The purpose of the video was to reveal any issues that he might have had while 
using the PAINT module and to find out whether any aspects of the PAINT 
method that were hard to understand. 

When analyzing the video, it seems that the key point in the usability of 
the PAINT method and the PAINT module is informing the decision maker 
about the approximate nature of the method. In order to make the PAINT 
method more usable, it would be a good idea to produce an introductory video 
introducing the key points of the method. Since our decision maker was already 
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familiar with the IND-NIMBUS® software, there was no need to introduce it. 
This may not always be the case and, thus, the video should also include a 
short introduction to the NIMBUS method and the IND-NIMBUS® software. 

The decision maker thought that the PAINT method and the PAINT mod- 
ule were easy and intuitive to use. In addition, he said that the PAINT method 
provided a definite improvement to merely using the NIMBUS method because 
of the faster computational times (a couple of seconds against half an hour) 
between the iterations of the interactive method. He thought that neither the 
approximate nature nor the fact that the preferences had to be based only on 
the objective function values were big drawbacks. In addition, no approximate 
outcomes that the decision maker would have assessed implausible were found 
during the decision making process. 

For both projected approximate outcomes s 1 and s 4 , our decision maker 
assessed that the actual Pareto optimal solutions were close enough, taking into 
account the uncertainties in the model, and there was no need to recompute 
the Pareto front approximation. Thus, the inability of the PAINT module in 
reconstructing the Pareto front approximation (as mentioned in Section [3]) was 
not an issue. 

Except for correcting a couple of minor bugs from the software, the decision 
maker did not offer any improvements. He did, however, agree with us that the 
PAINT method should be able to detect disconnectedness in the Pareto front 
and that the decision variables should be somehow approximated, too. How- 
ever, detecting disconnectedness was not an issue on this occasion, because all 
the approximate Pareto optimal outcomes found seemed plausible to the deci- 
sion maker and the approximate Pareto optimal outcomes that were projected 
were rather close to their projections. Finally, since one of the decision vari- 
ables was also an objective (i.e., the methanol dose), that was approximated in 
our problem, although the PAINT method does not in general do this. 

6 Conclusions 

In this paper, we described how the PAINT method can be used to speed up 
iterations of interactive methods when solving computationally expensive mul- 
tiobjective optimization problems. The PAINT method was used to construct a 
Pareto front approximation that then implied a mixed integer linear surrogate 
problem for the original problem. As our case problem, we studied a five- 
objective optimization problem of designing and operating a wastewater treat- 
ment plant. In addition, we introduced a new IND-NIMBUS® PAINT module 
that combines the PAINT method and the interactive NIMBUS method. 

The PAINT method and the PAINT module worked well in this problem. 
The decision maker found it easy and intuitive to use the interactive NIMBUS 
method to find a preferred approximate outcome on the Pareto front approx- 
imation. The low computational cost of using the interactive method with 
the surrogate problem was a definite improvement to using interactive method 
directly to solve the computationally expensive wastewater treatment problem. 

The experimental design in this paper was unique: Because our decision 
maker had already used the IND-NIMBUS® to study the same wastewater 
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treatment problem, he was able to compare the experiences of using the IND- 
NIMBUS software with and without the PAINT method. According to the 
decision maker's opinion, the PAINT method provided a significant improve- 
ment. This implies that the PAINT method should be also applicable to other 
computationally expensive problems. 

The IND-NIMBUS® PAINT module is still in the development phase and, 
thus, it lacks some essential functionality (like the implementations of the other 
scalarizations of the synchronous NIMBUS method) and, also, it still has some 
bugs. If there had been no bugs in the software, the investigation of the problem 
with the PAINT module would have been even more fluent. Further effort has 
to be put in correcting these bugs. 

The PAINT method requires one to use additional methods and software to 
generate the given set of Pareto optimal outcomes and to solve the mixed integer 
linear surrogate problem. In this paper, we used the UPS-EMO algorithm to 
generate the Pareto optimal outcomes and the IND-NIMBUS software with the 
PAINT module and the CPLEX solver to solve the surrogate problem. In future 
research, other applicable methods and software can be also used together with 
the PAINT method. 
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